BBN HARC and DELPHI Results on the ATIS Benchmarks - February 1991
نویسندگان
چکیده
This paper presents the test results of running BBN's HARC spoken language system and DELPHI natural language understanding system on the ATIS benchmarks. We give a brief system overview, and review the major changes that have been made in Delphi since the last DARPA SLS workshop. We will briefly discuss the development and training process, and then present our test results and an analysis of their meaning. S Y S T E M O V E R V I E W Delphi is BBN's research NL system, which is based on a unification grarnrnar and which incorporates semantics into the unification framework. Delphi is the NL component of the BBN HARC (Hear and Respond to Continuous Speech) system; integrated with the BYBLOS speech recognition system using an N-best architecture [1,2]. Figure 1 shows the relationships among the components of HARC, and their inputs and outputs.
منابع مشابه
BBN BYBLOS and HARC February 1992 ATIS Benchmark Results
In the official scoring, conducted by NIST, BBN's HARC system 3. produced a weighted SLS score of 43.7 on all 687 evaluable utterances in the test set. This was the lowest error achieved by any of the 7 systems evaluated. 4. For the SPREC evaluation BBN's BYBLOS system achieved a word error rate of 6.2% on the same 687 utterances and 9.4% on the entire test set of 971 utterances. These results ...
متن کاملBBN ATIS System Progress Report - June 1990
This paper reports recent progress on the development of the Delphi natural language component of the BBN spoken language system for the ATIS domain, focussing on the comparative evaluation performed by NIST in Jtme, 1990. 1. Delphi and Parlance/Learner Delphi is BBN's research NL system (formerly called CFG), which is based on a unification grarnmax and which incorporates semantics into the un...
متن کاملSyntactic and Semantic Knowledge in the DELPHI Unification Grammar
This paper presents recent natural language work on HARC, the BBN Spoken Language System. The HARC system incorporates the Byblos system [6] as its speech recognition component and the natural language system Delphi, which consists of a bottom-up parser paired with an integrated syntax/semantics unification grammar, a discourse module, and a database question-answering backend. The paper focuse...
متن کاملBYBLOS Speech Recognition Benchmark Results
This paper presents speech recognition test results from the BBN BYBLOS system on the Feb 91 DARPA benchmarks in both the Resource Management (RM) and the Air Travel Information System (ATIS) domains. In the RM test, we report on speaker-independent (SI) recognition performance for the standard training condition using 109 speakers and for our recently proposed SI model made from only 12 traini...
متن کاملThe Bbn/harc Spoken Language Understanding System
We describe the design and performance of a complete spoken language understanding system currently under development at BBN. The system, dubbed HARC (Hear And Respond to Continuous speech), successfully integrates state-of-the-art speech recognition and natural language understanding subsystems. The system has been tested extensively on a restricted airline travel information (ATIS) domain wit...
متن کامل